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REMARKS 

Claims 1-1 1 are pending in this application. 
Rciectio.1 of Oaini 1 i.ndor USC S 1 1?.^ F.v ^t Fa, a< .r^ph 

Claim I is rejected under 35 U.S.C. 1 12, fln=t parag-aph, as failing to comply 
with the enablement requirement. 

Claim 1 of the present claimed invention recites a method for constmcting a 3D 
scene model by analysing image sequences. Each image corresponds to a viewpoint 
defined by its position and its orientation. A depth map corresponding to the deptli in 
3D space of the pixels of the i„,age is calculated. Next, a resolution map comsponding 
to the 3D resolution of the pixels of the image f,x>m the depth map is calculated. A pixel 
of a current image is then matched with a p.xel of another image of the sequence. 
Pixels relating to one and the same point of the 3D scene are detemiined by projecting 
the pixel of the citirent image onto the other image. Then, a pixel of the cuirent image 
is selected depending on its resolution and on that of the pixels of other images of the 
sequence matched with this pixel. A 3D model is then constn,cted from the selected 
pixels. 

The Omce Action contends that the calculation of the depth map is not 
explained and that it is unclear as to whether the calculated depth maps for each image 
is within the scope of the invention. Applicant respectfully disagrees. Page 4, lines 26- 
3 1 , of the specification describes ^'tJiat by suitable processing, known from the pnor art. 
we obtain, for each viewpoint, its 3D position in a reference fiTime associated with the ' 
scene (position and orientation of the viewpoint), as well as a depth map associated 
with the image relating to the viewpoint." 

The depth maps can be created, for example, from two images using stmcture- 
from-motion algorithms, through active acquisition techniques (e.g. stn.ctxued light) or 
passive acquisition techniques (e.g. laser scanning). U.S. Patent No. 5.793,900 titled 
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"Gene.., C.e,oH., Oep. Maps Usn, P.s.ve ^^:^:J!:rZL 
Mach,nc for Video-rate Dense Depth Mapping and It. New Apphcations (1996)'^ by T 
Kanade e( al. are two documents (hat describe Z-buffering and depth map caJcu!at.o,.s 
Cited pr,or art PCT Application EP()7355 1 2 A2 also explains a way to calculate depth 
■nformafon and mentions documents explaining such calcuhUions (see page 3, §2: 
creation of dcpt infonnalion). 

Althottgh standard cameras can be used for the acquisition of the images a 3D 
camera acquires depth info^ation. Depth ,s measured by computing the time-of-flight 
of a ray of hght as it leaves the source and ,s reflected by the objects in the scene. The 
round-trip time is converted to digital code independently for each pixel. Consequently 
one skilled in the art of image processing, for example by using speci fic cameras or 
algorithms calculating the depth of the 3D points relating to the pixels of the image, is 
able to calculate depth maps or Z-buffcrs. 

In view of the above remarks, it is respectfully submitted that the specification 
is fully enabling. Thus it is further respectfully submitted that this rejection is satisfied 
and should be withdrawn. 



Rejection of Claim.s 1. 9 and 1 1 und^r 35 VfiC § in?(») 

Claims 1 , 9 and U are rejected under 35 U.S.C. 102(e) as being anticipated by 
Davison et al 

The present claimed invention provides a method for constracting a 3D scene 
model by analyzing image sequences. Each image corresponds to a viewpoint defined 
by its position and its orientation. A depth map coiTesponding to the depUi in 3D space 
of die pixels of the image is calculated. Next, a resolution map corresponding to the 3D 
resolution of the pixels of the miage fiom the dcpUi map is calculated. A pixel of a 
current image is then matched widi a pixel of another image of the sequence. Pi.xels 
relating to one and the same point of the 3D scene are determined by projecting the 



PACE 7/18 • RCVD AT 7/27/2006 2:55:52 PM [Eastern Daylight Timel • SVR:USPTO-EFXRF-6/33 * DNIS:2738300 • CSID:121 29710417 * DURATION <mm-ss):07^ 



07/27/2006 15:17 FAI 12129710417 



JACK SCHWARTZ & ASSOC. 



ID008 



Application No 09/811 OOP 

oixel oftho on-.. : ' , Attorney Docket No. PF990061 

p.xol of Ih. cm.ent »iinge onto the other image. Then, a pixel of .he current imnge .s 

selected depending on its resolution and on tliat of the pixels of other xmage., of the 
sequence matched with this pixel. A .3D model is then cor.stn.cted from the seiecled 
pixels. The mvention relates to a process for constructing a 3D scene model by 
analyzing image sequence. 

Davison et al. neither disclose nor suggest •'calculation, for an image, of a 
resolution map con espondrng to the 3D resolution of the pixels of the image, from the 
depth map", as claimed in claim 1 of the present claimed invention. Davison et al. 
additionally neither disclose nor suggest "caleulation, for an image, of a depth map 
corresponding to die depth, in 3D space, of the pixels of the image", as claimed in 
claim 1 of the present claimed invention. Davison et al. also neither disclo.se nor 
suggest "selection of a pixel of the current image dtT^ending on its resolution and on 
that of the pixels of other images of the sequence matched with this pixel"' as claimed in 
claim I oflhe present claimed invention. 

In the present claimed invention, the 3D resolution is defined throughout the 
specification, and inore specifically on page 5, lines 14-21. For each of the pixels 
belonging to a window, the depth infomation is processed so as to determine, from the 
distribution in 3D space of the fx^ints around the processed pixel, the 3D resolution. For 
a current pixel, its 3D rest^lution depends on the depth of neighboring 2D pixels. After 
processing all the pixels of the image, a resolution map of the image is obtained for 
each of the images of the sequeiKe and the range of the depth values of these pixels 
determines the resolution. Furthermore, in the present claimed invention, an image 
corresponds to a viewpoint deHncd by iLs position and its orientation. Starting from a 
pixel of the image i, it is possible to detennine its projection point in an itnage j via 
known geometrical transfonnation, as describwl on page 8, lines 20-21. The present 
clanned invention aiins to create a process allowing for improvement in the possibilities 
of navigation in the virtual scene. 

Davison et al. describe an apparatus and method for creating three-<limensional 
models of an object. The images of the object are taken from different unknown 
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same pomt on the actual object. The match.ng points are used to detcn.i„e the relative 
posu.on.s frott. wh.ch the nnages an. taken, and the matching points and calculated 
pos.t.ons are used to calculate po.nts in a 3D space representing poinus on the object. 

Relating to the depth map, ,he Office Action interprets the camera onenlation 
and the positions as depth maps because the points in the image are dete.-mined 
relative to their captnre viewpoints. The Office Action further inteT,rets the resolution 
"as being necessaty to matching points or features". The definition of a depth map or 
a 3D resolution, however, does not allow such an assimilation which is conside,-ed hy 
.he applicant as a hindsight approach. The definition of a 3D resolution, as provided 
in our previous response, is the distribution of the points of the 3D scene related to 
pixels around the processed pixel allowing the determination of resolution 
(Specification, page 5, lines 14-21). A resolution corresponds to a number of point, (a 
distribution) withm a given range (a given depth value). Davison et al. consider 
distances between 3D points relating to only a point of the 3D scene, but calculated by 
different cameras. Davison et a!., however, neither disclo.se nor suggest "calculation, 
for an image, of a resolution map corresponding to the 3D .^solution of the pixels of 
the image, from the depth map", as claimed in claim 1 of the present claimed 
invention. 

The calculation of/, values in Davison et al. is not the same as the calculation 
of a 3D resolution as in the presem claimed invention. In the present claimed 
invention, the calculation of a 3D resolution, or the use of a 3D resolution map for a 
selection step as these z values, are processed by matching only 3D points and 
calculating a standard deviation of the z-coordinates.. Davison et al. do not require 
density of point in the scene, and does not suggest such a calculation to perfom, this 
matching. Thus, Davison et al. neither disclose nor suggest "calculation, for an image, 
of a depth map corresponding to the depth, m 3D space, of the pixels of the image"', as 
claimed in claim 1 of the present claimed invention. 
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match the points and to represent points in 3D space, as the figures illustrate 
Apphcant respectfully disagrees as calculating a 3D resolution to n,atch the points 
corresponding to different camera positions is t.ot necessao'. Furthennore, Davison et 
al. do not disclose or suggest the calculation of a 3 D resolution which is a 
characteristic of the present claimed invention. 

Additionally, the Office Action, citing steps 558-560, Fig. 44a, contends that 
Davison ct al. disclose selecting a pixel of the cun^nt image depending on its 
resolution, referring to the shift or distance between pixels. The selection in Davison 
et al.. however, co-responds to acctu-acy. Applicant respectfully submits thai accuracy 
IS not the same as resolution. Thus, Davison et al. neither disclose nor suggest 
"selectum of a pixel of the cunent image depending on iLs resolution and on that of 
the pixels of other images of the seciuence matched with this pixel" as claimed in 
claim I of the present claimed invention. 

While Davison et al. describe a delermimng shift, this determining shift refers 
to -errors" or "shifts" between pixels or clnsters of 3D pints. The cluster relates only 
to a point of an object in 3D space. The representation of only a point of an object in 
3D space can not be assimilated to a 3D resolution. The rt^solution requires at least the 
calculation of the distance between two different 3D points of a 3D scene. 
Assimilating an error relating to the position of a point in 3D space to a 3D resolution 
IS not a broad intcipretation of a 3D resolution, Furthermore, in Davison et al., the 
points correspond to a single point on the surface of the actual object 24 (Davison et 
al., col. 43. line 63). This shift is the error relating to the same3DjMnt when using 
different cameras. 

Step S558 of Davison et al. determines whether the magnitude of Ihe shift 
calculated at step S554 is greater than 1 0% of the object size calculated at step S55^ 
If the shift is greater than 10%, the point under consideration for the current pair of 
camera positions and the eoiresponding point for the subsequent pair of camera 
positions are considerxjd to be inaccurate and discarded at S560 (Davison ct al. 
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column 44, lines 6-24). result the sh.f. or in.-. ."r^ ^""-''^^^^'^ ' 

y <i rthuit, the .sliifi or inter-point distance represents an enor 

Although the shift cotresponds to different pixels in the 2D representation, the shift 

relates to only a 3D point. Thus, the shift represents si mplv a sinde noint in .n.. . as 

opposed a distance between two 3D points. As this shift provide only 2D accuracy 

and relates only to a 3D point, this shift can not be the distances betwee.i two different 

3D pomts and consequently can not be considered 3D resolution. 



Davison et ai. also describe the luse of grid squares of different sizes to 
determine density of point s in the respective images to be matched. "The number and 
density of points in the ftrst image of the pair to be considered for matching.. " 
(Davison et al., col. 21, line 20^21 ) clearly describe a 3D resolution. The present 
claimed invention defines a 2D resolution as an image comprising pixels, or a 
calculation of a resolution map or density of poinLs within an image. A 3D resolution, 
however, relates to these pixels or resolution maps in correspondence to a number of' 
3D points within a depth range. 

Consequently, inter-point distjmce, as described in Davison et al., can not be 
assimilated to 3D resolution. Inter-point distance only provides accunicy in 2D. Thus, 
Davison et al., even when broadly interpreted, does not anticipate claim 1 of the 
present invention. 

(n view of the above remarks it is respectfully submitted that there is no 35 USC 
1 12 compliant enabling disclosure in Davison et al. showing the above discussed 
features. As claims 9 and 1 1 are dependant on claim I it is respectfully submitted that 
these clauns are allowable for the same reasons as discussed above. It is thus ftirther 
respectfully submitted that claims 1 . 9 and 1 1 are not anticipated by Davison et al. It is 
thus, further respectfully submitted that this rejection is satisfied and should be 
withdrawn. 
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Claim 2 is rejected under 35 U.S.C. I03(«) as being unpatentable over Davis<.a 
etal., in view of Azarbayejani et al. (U.S. Patent 5,51 1,153). 

Similarly to Davison et al., Azarbayejani et al. neither disclose nor suggest 
"calculation, for an image, of a resolution map concsponding to the 3D resolution of 
«he p,xels of the image, from the depth map", a., claimed in claim 1 of the present 
claimed invention. A.arbayejani et al., also similarly to Davison et al., neither disclose 
nor suggest "calculation, for an image, of a depth map corresponding to the depth, in 
3D space, of the pixels of the image", as claimed in claim 1 of the present claimed 
invention. 

Azarbayejani et al. describe a method and apparatus for geiierating a three- 
dimensional, textured computer model from a series of video images. The invention 
operates by tracking a selected group of object features tlirough a series of image 
frames, and based on their relative positions, estimates parameters specifying camera 
focal length, translation and rotation, and the positions of the tracked features in the 
camera reference frame. Unlike the present claimed invention, Azarbayejani et al. are 
not concerned with calculating a rx^solution map co.responding to the 3D resolution of 
pixels of the image from the depU, map. Azarbayejani et al are also not conceded xvith 
calculating a depth map corresponding to the dej^th in 3D space of the pixels of the 
image. Thus, similarly to Davison et al., Azarbayejani et al. neither disclose nor suggest 
-calculation, for an image, of a resolution map corresponding to the 3D resolution of 
ilie pixels of the image, from the depth map", as claimed in claim I of the present 
claimed invention. Azarbayejani et al., also similarly to Davison et al., neither disclose 
nor suggest "calculation, for an image, of a depth map corresponding to the depth, in 
3D space, of the pixels of the image", as claimed m claim 1 of the present claimed 
invention. 



Additionally, the combination of Azarbayejani et al. and Davison et al. would 
not produce .he present claimed invention. This combination would produce an image 
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processHig apparatus for creating a 3D tcxtt.red computer model form a series of 
video games. This combination neither discloses nor suggests "caiculnt.on, for an 
image, of a resolution map corresponding to the 3D resohuion of the pixels of the 
image, from the depth map", as claimed in claim I of die present claimed invention. 
The combined system also neither disclose nor suggest "calculation, for an image, of 
a depth map corresponding to tJie depth, in 3D space, of the pixels of the image", as 
claimed in claim 1 of the present claimed invention. 

In view of the above remarks it is respectfully submitted that there is no 35 USC 
1 12 compliant enabling disclosure contained within Davison et al. and Azarbayejani et 
aJ., when taken alone or in combination, showmg the above discussed features. It is 
thus ftirther resptxtfuUy submitted that the present claimed invention is patentable over 
Davison ct al. and Az<«rbayejani et al.. when taken alone or in combination. As claim 2 
is dependent on claim 1, it is respectfully submitted claim 2 is allowable for (he same 
reasons discus.sed above regarding independent claim 1 . Thus, it is further respectfully 
submitted that (his rejection is satisfied and should be withdrawn. 



Rejectio n of Claims 4. 5 under 35 USC § 10.1( a) 

Claims 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Davi.son et al., in view of McAllister et al. (Real-Time rendering techniques of real 
world environments). 

Similarly to Davison et al., McAllister et al. neither disclose nor suggest 
"calculation, for an image, of a resolution map coiresponding to the 3D resolution of 
the pixels of the image, from the depth map", as claimed in claim 1 of the present 
claimed invention. McAllister et al., also similarly to Davison et al., neither disclose 
nor suggest "calculation, for an image, of a depth map coiresponding to the depth, in 
3D space, of the pixels of the image", as claimed in claim 1 of the present claimed 
invention. 
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McAllister et al. rectc an end-to-end «y«te.n Tor acquiring highly detailed 

scans of large real world spaces, consisting of fony to eighty million raiige and color 

samples, using a digital camera and laser rangefinder. Unlike the present claimed 

invention, McAllister et al. are not concerned with calculating a resolution map 

corresponding to the 3D resolution of pixels of Uie image from the depth n,ap. 

McAllister et al. are also .tot concerned with calculating a depth map correspondtng to 

the depth in 3D space of the pixels of tl,e image. Thus, similarly to Davison et af, 

McAllister et al. neither disclose nor .suggest "calculation, for an image, of a 

resolution map corresponding to the 3D resolution of the pixels of the image, from the 

depth map", as claimed in claim 1 of the present claimed invention. McAllister et al., 

also similarly to Davison et al., neither disclose nor suggest "calculation, for an 

■mage, of a depth map corresponding to the depth, in 3D space, of the pixels of the 

image", as claimed in claim 1 of the present claimed invention. 

Additionally, the combination of McAllister et al. and Davison etal. would 
not produce the present claimed invention. This combination would produce an end- 
to-end system for acquiring highly detailed scans of large real world spaces using a 
digital camera and laser rangefinder for processing 3D models of objects. This 
combination neither discloses nor suggests "calculation, for an image, of a resolution 
map corresponding to the 3D resolution of the pixels of the image, from the depth 
map", as claimed in claim 1 of the present claimed invention. The combined system 
also neither disclose nor .suggest "calculation, for an image, of a depth map 
corresponding to the depth, in 3D space, of the pixels of the image", as claimed in 
claim 1 of the present claimed invention. 

in view of the above remarks it is respectfully submitted that there is no 35 USC 
1 12 compliant en<ibling disclosure contained within Davison et al. arid McAllister et 
al., when taken alone or in combination, showing tl,e above discussed features. It is 
thus further respectfully submitted thai the present claimed invention ,s patentable over 
Davison et al. and McAllister et al., when taken alone or in combination. As claims 4 
and 5 are dependent on claim 1, it is respectfully submitted they are allowable for the 
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same reasons discussed above i-egarding independent claim 1. Thus, il is further 
respectfully submitted that this rejection is satisfied and should be withdrawn. 



Rejection of Claim 10 under 35 USC S 103f a) 

Claim 1 0 is rejected under 35 U.S.C. 103(a) as being unpatentable over Dav.s, 
et al., in view of La Roux et al. (An Overview of Moving Object Segmentation in 
Video Images, IEEE, 1991). 



Similarly to Davison et al.. La Roux et al. neither disclose nor suggest 
"calculation, for an image, of a resolution map corresponding to the 3D resolution of 
the pixels of the image, from the depth map", as clamred in claim 1 of the present 
claimed invention. La Roux et al., also similarly to Davison et al., neither disclose nor 
suggest "calculation, for an image, of a depth map corresponding to the depth, in 3D 
space, of the pixels of the image" as claimed in claim 1 of the present claimed 
invention. 

La Roux et al. disclose a method for modelling a 3D object from an image 
sequence. 3D objects are modelled by combining stotc-of-the-arl algorithms for un- 
calibrated projective reconstruction, self calibration and dense con^spondence 
matching. Unlike the present claimed invention. La Roux et al. are not concerned with 
calculating a resolution map corresponding to the 3D resolution of pixels of the image 
from the depth map. U Roux et al. are also not concerned with calculating a depth 
map corresponding to the depth in 3D space of the pixels of the image. Thus, 
similarly to Davison et al., La Roux et al. neither disclose nor suggest "calculation, for 
an image, of a resolution map conesponding to the 3D resolution of the pixels of the 
image, from the depth map'\ as claimed in claim I of the present claimed invention. 
La Roux et al., also similarly to Davison et al., neither disclose nor suggest 
"calculation, for an image, of a depth map corresponding to tlie depth, in 3D space, of 
the pixels of the image", as cla imed in claim 1 of the present claimed invention. 
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Addkionally, the combinaUon of La Roux et al. and Dav.son et ai. would not 
produce the prcson, claimed .nvem.on. Th. co.nbina.on would produce an appa,.u,s 
tor processing 3D n.odeJs of objects from a„ in.agc sequence. This co.nb.nation 
neither d.scloses nor suggests "calculation, for an image, of a resolution ntap 
corresponding to the 3D resolution of the pixels of the image, from the depth map" as 
clatmed ,n claim 1 of the present cla imed invention. The combined system also 
neuher disclose nor suggest "calculation, for an image, of a depth map corresponding 
to the depth, in 3D space, of the p.xels of the tmage'", as claimed in claim 1 of the 
present claimed invention. 

In view of the above remarks it is respectfully submitted that there is no 35 USC 
1 12 compliant enabling disclosure contained within Dav.son et al. and La Roux when 
taken alone or in combination, showing the above discussed features. It is thus f^nther 
respectfully submitted that the present claimed invention is patentable over Davison et 
al. and La Roux, when taken alone or to combination. As claim 10 is dependent on 
clann I, it is respectfully submitted claim 10 is allowable for the .same rea.sons 
discussed above regarding independent claim 1 . Thus, it is IVirther respectflilly 
submitted that this rejection is satisfied and should be withdrawn. 

Claims 3 and 6-8 liave been allowed. In view of the above remarks, it is 
respectft,lly submitted that claims I, 2. 4, 5 and 9-1 1 are aUowable. 

Having fiUIy addressed the Examiner's rejections, it is believed that in view of 
the preceding remarks, this application stands in condition for allowance. Accordingly 
then, reconsideration and allowance are respectfully solicited. If, however the 
Examiner is of the opinion that such action cannot be taken, the Examiner^ invited to 
contact the applicant's attorney at the phone mnnber below, so that a mutually 
convenient date and time for a telephonic i«te.view may be scheduled. 



15 



PAGE 16/18 • RCVD AT 7/27/2008 2:SS:92 PM (Eastern Daylight Tbne] • 8VR:U8PTO-EFXRF-e/33 • DNI8:2738300 ' C8ID:12129710417 * DURATION (mm-SS):07-44 



07/27/2006 15:21 FAX '12129^10417 



JACK SCHWARTZ & ASSOC. 



iaoi7 



ApplicmK>n No. 09/83 L992 ^ f,^,^,^,. 

No fee ,s beheved due. However, if. fee is due, plea.se charge the .dditio,.,! fee 

to Deposit Account 07-0832. 



Respectftilly submitted, 
Yannick Nicolas 




//Jack St'hwijtz \ 
R^g'^No. 34,72 f^^ -" 
Tel. No. (609)734-6866 



Thomson Licensing Inc. 
Patent Operations 
PO Box 5312 
Princeton, NJ 08543-5312 
May 4, 2006 
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